Memory Access Optimization and RAM Inference for Pipeline Vectorization

This paper describes memory access optimization in the context of pipeline vectorization, a method for synthesizing hardware pipelines in recon gurable systems from software program loops. Since many algorithms for recon gurable coprocessors are I/O bound, the throughput of the coprocessor is determined by the external memory accesses. Thus access optimizations directly improve the system's performance. Two kinds of optimizations have been studied. First, we consider methods for reducing the number of accesses based on saving frequentlyused data in on-chip storage. In particular, recent FPGAs provide on-chip RAM which can be used for this purpose. We present RAM inference, a technique which automatically extracts small on-chip RAMs to reduce external memory accesses. Second, we aim to minimize the time spent on external accesses by scheduling as many accesses in parallel as possible. This optimization only applies to architectures with multiple memory banks. We present a technique which allocates program arrays to memory banks, thereby minimizing the overall access time.